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ABSTRACT 

The purpose of this causal-comparative study was to 
compare reasoning level, American College Test (ACT) science, process 
skills r and physical science misconceptions of preservice elementary 
and secondary science teachers and to investigate gender differences. 
The stratified randomly drawn sample (n=68) consisted of preservice 
elementary and secondary science methods teachers. During the first 
two weeks of classes, the Group Assessment of Logical Thinking 
(GALT) , the Integrated Process Skills Test II (TIPS II), and the 
Physical Science Test (PST) were administered. Seventy-six percent of 
the sample (85% of secondary and 68% of elementary) were formal 
reasoners. Fifty percent or more of the preservice elementary 
teachers correctly answered all items on TIPS II except one. 
Sixty-five percent or more of the preservice secondary teachers had 
correct responses to the TIPS items. Misconceptions in 
e].ectromagnetic phenomena/electricity/light, motion, and mass were 
found most often. Significant two-way ANOVAs (p .01) were found on 
the ACT Science in favor of the secondary teachers and on the PST in 
favor of males and secondary teachers. (Author) 
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PRESCRVICE ELEMENTARY AND SECONDARY SCIENCE METHODS 
TEACHERS: COMPARISON OF FORMAL REASONING, ACT SCIENCE, PROCESS 
SKILLS, AND PHYSICAL SCffiNCE MISCONCEPTIONS SCORES 

Abfitrad 

The purpose of this causal-ccmiparative study was to compare reasoning level, 
ACT science, process skills, and physical science misconceptions of preservice elementary 
and secondary science teachers and to investigate gender differences. The stratified 
randomly drawn sample = 68) consisted of preservice elementary and secondary 
science methods teachers. During the first two weeks of classes, the GALT, TIPS H, and 
PST were administered. Seventy-six percent of the sample (85% of secondary and 68% 
of elementary) were formal reasoners. Fifty percent or more of the preservice elementary 
teachers correctly answered all items on TIPS n except one. Sixty*five percent or more 
of the preservice secondary teachers had correct responses to the TIPS items. 
Misconceptions in electromagnetic phenomena/electricity/light, motion, and mass were 
found most often* Significant two-way ANOVAs (b < •Ol) were found on the ACT 
Science in favor of the secondary teachers and on the PST in favor of males and 
secondary teachers. 

Purposes of the Study 

In this causal-comparative study, reasoning level, ACT science, process skills, 
and physical science misconceptions scores of preservice elementary and secondary 
science methods courses were compared. Also investigated were gender differences. 

SigniTicaiitt of the Stu4y 

The goal of science education is the production of scientifically and 
technologically literate citizens (Yager, 1984). The responsibility of such rests on the 
schools and universities (Hazen & Trefil, 1991). Acquisition and utilization of tfiinking 
skills and processes, e.g., the 10 rational powers (Education Policies Commission, 1961), 
five formal operational modes (Capie, Newton, Tobin, 1981; DsCarcer, Gabel, & Staver, 
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1978; Inhelder & Piaget, 1958; Lawson, 1982; Lawson, 1985; Linn, 1982), process skills 
(Bums, Okey, & Wise, 1985; Padilla, 1987), critical thinking skills (Adler, 1983; Blosser, 
1985; Boyer, 1983; National Science Board Commission, 1983) are essential for 
funcUoning in the "InfoimaUon Age Society" (Costa, 1989; Naisbitt, 1982; Peters & 
Waterman, 1982; Resnick & Klopfer, 1989; Tofler, 1980). Formal operational reasoning 
predicts achie?ement in science and mathematics (Bitner, 1986, 1988a, 1988b, 1991b; 
Hofstein & Mandler, 1985; Howe & Durr, 1982; Lawson, 1983; Lawson, Lawson, & 
Lawson, 1984) and critical thinking abiliUes (Bitner, 1988a, 1988b, 1991b). 

Baker (1991); Bitner (1991a); Champagne (1983); Champagne, Klopfer, and 
Anderson (1980); Clement (1982); and Lawrenz (1986) have reported instances of science 
misconceptions among high school and university students and teachers. The most 
frequently identified physical science misconceptions related to electromagnetic 
phenomena/electridty/light, motion, and mass. Lawrenz (1986) called for the resolution 
of science misconceptions; Clement & Brown (1984) recommended the use of analogical 
reasoning in overcoming science misconceptions. Lawson, Abraham, & Renner (1989) 
recommended the convtructivist process. 

Design 

In this causal-comparative study, frequency and two-way ANOVA (SPSS, 1990) 
were used to analyze the data. The independent \ oriables were gender and methods 
class (elementary or secondary); the dependent variables were formal reasoning, ACT 
Science, process skills, and physical science misconceptions scores. 

Sample 

The stratified randomly drawn sample (S = 68) for this causal-comparative 
study consisted of preservice elementary and secondary science methods teachers in a 
midwestem university with a student enrolbnent of approximately 20,000. The Teacher 
Education Program has an enrolbnent of approximately 2,500. For admittance into the 
Teacher Education Program, students must have completed 45 credit hours with a GPA 
of 2.4, an American College Test (ACT) composite of 20, and a College Basic Academic 
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Subjects (C-BASE) composite of 235. The preservice derientary teachers are required 
to complete three science courses plus the elementary science methods course. The 
preservice secondary science teachers must meet the requirements of their m^jor. 

The sample consisted of eighteen males and forty females. On the a?erage, the 
preservice dementary teachers were 23.52 years of age (SD ^ 4.(i3, with a range of 20 - 
40) and had a college GPA of 3.31 on a scale of 4.0 (SD = .48). The preservice 
scrcondary science teachers averaged 29.54 in age (SD = 9.14), with a range of 20 - 53. 
The mean GPA for this group was 3.15 (SD = AT). Of the elementary teachen% 12% 
had completed no er^h science courses and 18% had completed no physical science 
courses. The elc^nentary mt^ors had a mean ACT composite score of 23.56 (SQ - 3.13 
with a range of 20 - 32) and a mean ACT Science sub-test of 24.53 (SS = 4.16 and 
range of 16 - 34). The secondary subjects' average ACT composite score was 25.15 (SD 
- 3.38 with a range of 20 - 31 ) with a M 27.35, SD = 3.22, and range of 20 - 32 on 
the Science sub-test. The average C-BASE composite for the elementary group was 
326.16 (SD = 44.88 with a range of 241 - 414); the mean C-BASE Science was 330.59 
(SD = 56.08, and range of 225 416). Somewhat higher results were found for the 
secondary teachers on the C-Base composite (M 357.75, SD - 46.17, range of 256- 
444) and Science sub-test (M = 372.45, SD ^ 61.29, range 236 - 466). 

Instrumentation 

Prior to admittance into the Teacher Education Program, the preservice 
teachers had taken the ACT and C-BASE. During the first two weeks of classes (1991 
spring, summer, and fall), the Group Assessment of Logical Thinking (GALT) 
(Roadrangka, Yeany, & P^dilla, 1982), the Integrated Process Skills Test H (TIPS II) 
(Okey, Wise, & Bums, 1982), and the Physical Science Test (Lawrenz, 1986) were 
administered to the population from which the sample was randomly selected. Included 
in the subsequent paragraphs are descriptions of the content, validity, and reliability of 
the instruments. 
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Because the ACT is a widely used and accepted test for collie entrance, the 
validity and reliability of the instrument will not be discussed. Suffice it to say that the 
mean is 20 sm^ the standard deviation 6. 

C-BASE, a criterion-referenced test, measures knowledge and skills in four 
academic areas, i.e., English, mathematics, science, and social siudies (Osterlind & 
Mertz, 1990). It is intended to assess the knowledge and competencies in the four 
academic areas covered in the goieral education component of an undergraduate d^ee 
program. The test consists of two cat^ories: the four content domains and three 
reasoning competencies. The reasoning competencies, arranged hierarchically, include 
interpretive reasoning, strategic reasoning, and adaptive reasoning. Fresentiy, C-BASE 
is used to admit candidates into teacher education programs in the State. For 
admittance a cut-off score of 235 is required. The numeric scores range from 40 to 565 
points (M = 300, SB = <>5). The internal consistency (K-R 20) of C-BASE ranged from 
.77 in English to .89 in mathematics. Validity was established (see Osterlind & Mertz, 
1990). Criterion-related evidence was established with the ACT, SAT, and GPA. A 
strong relationship was found among the C-BASE contents domains and the ACT, SAT- 
V, SAT-Q, and GPA categories. Of specific interest in this study are the reasoning 
competencies and the science domain test which consist of 41 items, measuring 
laboratory and field work and fundamental concepts in life and physical sciences. 

The abbreviated GALT, a twelve-item paper and pencil test of logical thinking 
consists of six modes of reasoning, one concrete operational (i.e., conservation) and five 
formal operational (i.e., proportional reasoning, controlling variables, probabilistic 
reasoning, correlational reasoning, and combinatorial logic). The test format for all 
items except the two combinatorial logic problems coasists of an illustration of the 
problem and multiple choice response for both the correct answer and justirication. For 
the combinatorial logic items, students must provide logical combinatorial patterns. The 
GALT was chosen to measure formal reasoning because of the validity and reliability 
results obtained by Roadrangka et al. (1983) on a sample of students ranging from sixth 
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grade through coH^e. Construct validity was established by determining convergent 
validity with Piagetian Interview Tasks (.80) ard by using the principal cmnponents 
method of factor analysis. The scores on the TIPS II were used to establish the 
criterion-related validity of the GALT. The correlation between the total GALT score 
and the total TIPS n was .71. A .85 coefTident was found for internal consistency by 
calculating Cronbach*s alpha (see Roadrangka et al., 1983). 

TIPS n, a thirty-six item multiple-choice test, measures five process skill 
objectives (i.e., identifying variables, identifying and stating hypothesis, operationally 
defining, designing investigations, and graphing and interpreting data). The test was 
designed to measure process skills of students in grades 7 - 12. Bums et al. (1985) 
reported mean scores ranging from 15.91 for seventh graders to 25.27 for students in 
grades 10 -12. Cronbach's alpha reliability coeffidoit for the total test was .86. The 
item difficulty indices ranged from .15 to .87 (M - .53). A range of .11 to .(>4 (M = 
.35) was reported for the point biserial discrimination indices. 

FST, a thirty-one item multiple-choice test, measures physical science concepts. 
Lawrenz (1986) constructed ^TT from the National Assessment of Educational Progress's 
(NAEP, 1978) released items for physical science for 17 year olds. The Kuder- 
Richardson reliability coefTident for the thirty-one items was .80. Lawrenz (1986) 
administered the PST to a sample of inservice elementary teachers who had voluntarily 
enrolled in a sdence course. She reported an item difficulty ranging from 34% to 90% 
and a mean score of 19 with a range from 5 - 30. Over 50% of the inservice teachers 
correctly answered items focusing on atomic energy, off-center balandng, averaging, 
lenses, batteries, density, stars, heat exchange, and chemical reactions. A score of 21 or 
below was reported for two-thirds of the sample. Fifty percent or less responded 
correctly to items 7, 20, 21, 23, 24, 25, 26, 27, 28, 29, and 31. Of these eleven items, 
Lawrenz identified items 20, 21, 23, 2S, 28, and 29 as rather "content spedfic or fact 
oriented" (p. 656). Difficulty with items 24, 27, and 31 indicate misconceptions about 
mass. The percent correctly answering items 24, 27, and 31 was 40, 50, and 36, 
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respectively* Only <i3% of the teachers correctly answered item 26, indicating a 
misconception about motion. She concluded that difficulty with items 7, 23, 25, and 28 
indicated a misconception about electrosnagnetic phenomena/ electricity/light. The 
percent of the teachers responding correctiy to items 7, 23, 25, and 28 was 34, 43, 41, 
and 38, respectivdy« 

Results 

Means* Standard Devia tions^ and Item Difficulty on the GALT 
In Table 1 are reported the means, standard deviations, and item difficulty for 
the six reasoning modes in the GALT. Of ths six reasoning modes in the GALT, 
correlational reasoning was the most difficult for the total sample and both groups. 



Insert Table 1 about here 



The distribution of the sample (N[ - 68) according to reasoning levels was 76% 
formal and 24% transitional (see Table 2). Sixty-eight percent of the preservice 
elementary teachers were formal; 32% were transitional* Somewhat higher percentages 
(i.e., 85% formal and 15% transitional) were found for the secondary teachers. 



Insert Table 2 about here 



Frequencies and Percents on the TIPS II 
The frequencies and percents for the 36 items on the TIPS n are included in 
TABLE 3* For this sample, the lowest responding rate was 54% for item 27, an 
identifying and stating hypothesis objective. Only 39% of preservice elementary teachers 
correctiy answered item 27* The percentage correctiy answering the thirty-six items for 
the secondary group was 65% or greater. For the elementary group, the percentage of 
correct responses was below 65% for four items (2, 13, 15, 27). Items 13 and 15 require 
the identification of variables. Item 2 is an operationally defining objective. The means 
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and standard deviations on the TIPS n were 29.41 and 6.31 (elementary) and 31.85 and 
3.58 (secondary), respectively. 



Insert Table 3 about here 



Frequencies and Perccnts on the Physical Science Test 
Fifty percent or less of the sample (^ - 68) responded correctly to items 7 
(magnetic field), 21 (temperature scales), 22 (speed), 24 (gas mass), 25 (electromagnetic 
field), 26 (motion), 28 Oight), and 31 (mass) (see Table 4). The mean score for the 
sample was 21 (SQi- 4.93). Only four percentages (13, evolution star; 25, 
electiromagnetic field; 27, mass earth; and 29, chemical reaction) fdl bdow 50% for thr 
secondary group. The mean and standard deviation for the secondary group v/ere 23.91 
and 3.91, respectively. Fifty percent or less of the elementary group correctiy responded 
to items 7 (magnetic field), 17 (mass), 19 (particles), 20 (mixtures), 21 (temperature 
scales), 22 (speed), 23 (electrical charge), 24 (gas mass), 25 (electromagnetic), 26 
(motion), 27 (mass earth), 28 (light), 29 (chemical reaction), 30 (atoms), and 31 (mass). 
The mean and standard deviation for the elementary group were 19.09 and 4.16, 
respectively. Items measuring electromagnetic phenomena/electridty/light, motion, and 
mass were the most difficult. 



Insert Table 4 about here 



Results of the Two-Wav ANOVAs 
The results of tiie two-way ANOVAs (GALT by gender and methods teacher, 
elementary or secondary) and (TIPS n by gender and methods teacher, elementary or 
secondary) were not significant at the M level. However, the two-way ANOVAs for 
ACT Science and PST were significant. The preservice secondary science methods 
teachers (M = 27.35, SD = 3.22) performed significanUy higher on the ACT Science 
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sub*test than the preservice elementary science methods teachers QV| ^ 24,53, ^ - 
4.27), £(lf<MS) - 7*16, B < Gender differences were not found on the ACT 
Science* Both gender and methods teacher had a significant effect on the PST. The 
preservice secondary science methods teachers QA -23*91, SQ - 3*81) outperformed the 
preservice demaitary science methods teachers ^ 18*09, S& ^ 4*16) on the PST, 
£(1,66) = 21*77, B < *001)* The males (M - 24*83, Sfi = 3*52) performed better than 
iiie females (M = 19*62, SD = 4*74) on the PST, (£ (1,66) = 7*07, b < *01)* 

CondusioiiB 

::>eventy-six percent of the sample (j^ = 68) was functioning at the formal 
operational level* A higher percentage (85%) of the preservice secondary science 
methods teachers were formal reasoners than the preservice elementary teachers (68%)* 
The percentage of formal reasoners in the elementary group was higher than the 51 . ; 
reported by Bitner (1991). Correlational reasoning was the most difficult for this 
sample, a result previously found by Bitner (1991a, 1991b)* 

The lowest responding rate was 54% for item 27, an identifying and stating 
hypothesis* The preservice elementary teachers experienced more difficulty with this 
item than the secondary teachers* The elementary teachers also had some difficulty with 
two identification of variables items (13 and 15) and one operationally defining item (2)* 
The percentage correctly answering the thirty-six process items for the secondary group 
was 65% or higher* It was expected that the secondary teachers would perform better 
than the elementary teachers because of their many laboratory experiences* 

The results of FST for the present study are similar to those reported by Baker 
(1991), Bitner (1991) and Lawrenz (1986)* The findings indicate misconceptions about 
electromagnetic phenomena/electridty/light, motion, and mass* As expected, the 
secondary teachers had less physical science misconceptions than the elementary 
teachers* 

It was expected that the pres^vice secondary science teachers would perform 
better than the preservice elementary science methods teachers because of the difference 
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in science background. Gender difference, however, was not anticipated. 

The diflference in ACT Science sub-test in favor of the secondary grofip may be 
a factor in students' decision to migor in science. The difference may emanate from the 
difference in high school science preparation. 

Overall, this sample performed well on the GALT and TIPS n« However, 
results on the PST indicate physical science mirxonceptions, especially for the preservice 
elementary teachers. If the responsibility of producing sdentincally literate citizens rests 
on the schools and universities (Hazen & Trefil, 1991), it is imperative that we evaluate 
what science is being taught and how it is being taught* The researcher recommends the 
constnictivist approach to teaching science. 
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Item 17 


.38 


.49 


38 


.68 


.48 


68 


.53 


.50 


53 


Item 18 


.24 


.43 


24 


.24 


.43 


24 


.24 


.43 


24 


Combinatorial 


1.74 


.45 


74 


1.62 


.55 


65 


1.68 


«50 


69 


Item 19 


.94 


.24 


94 


.94 


.24 


94 


.94 


.24 


94 


Item 20 


.82 


.39 


82 


.77 


.43 


76 


.79 


.41 


79 


GALT Total 


8.85 


2.06 




938 


1.67 




9.12 


1.88 





Hi 
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Table 2 

Levels of Rea« jning on the GALT (N = 68) 



Reasoning Levd 


Gnnp 


FormaT 


Trtiwirinnaf 


CoBcrctcr 




N 


% 


N 


% 


N % 


Elementmrj 












(a =34) 


23 


68 


11 


32 


0 0 


Female 












(n =31) 


21 


63 


10 


32 


0 0 


Male 












(a = 3) 


2 


67 


1 


33 


9 0 


Secondary 












(a = 34) 


29 


85 


5 


15 


0 0 


Female 












(a = 19) 


16 


84 


3 


16 


0 0 


Male 












(n = 15) 


13 


87 


2 


13 


0 0 


Total 












(N = 68) 


52 


76 


16 


24 


0 0 



'Score = 8-12 (M = 9.98, Sfi = 1.13) 
*Score = 5-7 (M = 6 31, SB = -70) 
"Score = 0-4 



17 
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TABLE 3 

FreouencY and Percent on TIPS H for Sample (N=68) 

Eiementsry Secondary Total 



(II = 34) (a- 34) (a =68 



Objectives/Items 


F 


% 


£ 


% 


£ 


% 


JllJvllMlJrUlK T MI Ullf IC3 








74 


55 


81 


30 


88 


25 


3 


32 


94 


32 


94 


64 


94 


13 


21 


62 


26 


76 


47 


69 


14 


28 


82 


30 


88 


58 


85 


IS 


18 


53 


29 


85 


47 


69 


18 


23 


68 


22 


65 


45 


66 


19 


27 


79 


30 


88 


57 


84 


20 


25 


74 


30 


88 


55 


81 


30 


27 


76 


22 


65 


48 


71 


31 


30 


88 


30 


94 


62 


91 


32 


27 


79 


31 


91 


58 


Off 

85 


36 


24 


71 


27 


82 


51 


76 


Identifying and 














Stating Hypothesis 














4 


30 


88 


32 


94 


62 


91 


6 


26 


76 


31 


91 


57 


84 


8 


30 


88 


30 


88 


60 


88 


12 


30 


88 


34 


100 




y4 


16 


26 


76 


32 


94 


58 


85 


17 


33 


97 


34 


100 


67 


99 


27 


13 


39 


23 


68 


36 


54 


29 


34 


100 


34 


100 


68 


100 


35 


29 


85 


32 


94 


Ol 


on 


Operationally 














Defining 








74 


45 


66 


2 


20 


59 


2b 


7 


30 


88 


30 


88 


60 


88 


22 


32 


94 


34 


100 


66 


97 


23 


24 


71 


31 


91 


55 


81 




33 


97 


31 


91 


64 


94 


33 


30 


88 


30 


88 


60 


88 


Designing 














Investigations 






34 


100 


65 


96 


10 


31 


91 


21 


33 


97 


28 


82 


61 


90 


24 


31 


91 


34 


100 


65 


96 


Graphing and 














InterpreOng Data 






26 


76 


51 


75 


5 


25 


74 


9 


32 


94 


32 


94 


64 


94 


11 


34 


100 


33 


97 


67 


99 


25 


29 


85 


30 


88 


59 


87 


28 


31 


91 


33 


97 


64 


94 


34 


32 


65 


28 


82 


50 


74 


Mean 


29.41 


31.85 


30.63 


Standard Deviation 


6.31 


3,58 


5.24 



IS 

ERIC 
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Table4 

Frequency and Percent on the Physical Science Test (N = 68) 



Item Elementary Secondary Total 





(n 


= 34) 


in. 


= 34) 


(n ■■ 


= 34) 




E 


% 


£ 


% 


F 


% 


l-Atoms 


33 


97 


32 


94 


65 


96 


2-Balances 


27 


79 


23 


ti8 


50 


74 


3-Weights 


30 


88 


31 


91 


60 


90 


4-Temperatmre 


33 


97 


33 


97 


66 


97 


5-Hypothesis 
(hReflectson 


30 
26 


88 
76 


33 
31 


97 
91 


63 
57 


93 
84 


7-lVfagnetic Field 


8 


24 


20 


59 


28 


41 


8-Voltage 


23 


68 


24 


71 


47 


69 


9-Leiis 


27 


79 


30 


88 


57 


84 


10-C3ombiistion 


26 


76 


32 


94 


58 


85 


ll*Path 


19 


56 


4»0 


59 


39 


57 


12- Densitv 

13- Evolution Star 


23 


68 


30 


88 


53 


78 


26 


76 


4 


27 


53 


78 


14-Star 


30 


88 


31 


91 


61 


90 


ic.H«it 


21 


62 


22 


68 


44 


65 


16-Chemical Bonds 


28 


82 


32 


94 


60 


88 


17-Ma&s 


14 


41 


25 


74 


39 


57 


18- CrysUb 

19- Particle9 


26 


76 


31 


91 


57 


84 


16 


47 


30 


88 


46 


66 


20-Mixture 


16 


47 


22 


6S 


38 


56 


21-Teiiiperature Scales 


10 


29 


20 


59 


30 


44 


22-Speed 


10 


29 


21 


61 


31 


46 


23-Electricai Charge 


3 


9 


30 


88 
59 


56 


82 


24-Gas Mass 


9 


26 


20 


29 


43 


2S-Electromagnetic 


3 


7 


3 


23 


30 


44 


26-Motion 


10 


29 


23 


68 


33 


49 


27-Mass Earth 


14 


41 


2 


28 


42 


62 


28- Light 

29- Cheinicai Reaction 


9 


26 


18 


53 


27 


40 


16 


47 


3 


9 


19 


56 


30- Atoms 


15 


44 


29 


85 


44 


65 


31-Mass 


4 


12 


18 


53 


22 


33 


Mean 


18.09 


23.91 


21.00 


Standard Deviation 




4.16 




3.91 




4.93 



ERIC 



